World Map

1 Exploratory Data Analysis III

1.1 Importing Public Data, WDI

1.1.1 Reviews and Previews

library(tidyverse)
library(gapminder)
library(maps)
library(WDI)

---

(df <- gapminder)

---

asean <- c("Brunei", "Cambodia", "Laos", "Myanmar", "Philippines", "Indonesia", "Malaysia", "Singapore")
df %>% filter(country %in% asean) %>%
  ggplot(aes(x = year, y = gdpPercap, col = country)) + geom_line()

---

df %>% filter(country %in% asean) %>%
  ggplot(aes(x = gdpPercap, y = lifeExp, col = country)) + geom_point()

---

df %>% filter(country %in% asean) %>%
  ggplot(aes(x = gdpPercap, y = lifeExp, col = country)) + 
  geom_point() + coord_trans(x = "log10", y = "identity")

\(\log_{10}{100}\) = 2, \(\log_{10}{1000}\) = 3, \(\log_{10}{10000}\) = 4

\(10^{2.5}\) = 316.227766, \(10^{3}\) = 1000, \(10^{3.5}\) = 3162.2776602,

\(10^{4}\) = 10^{4}, \(10^{4.5}\) = 3.1622777^{4}.

---

---

---

1.1.1.1 World Bank: World Development Indicators (WDI)

• SP.DYN.LE00.IN: Life expectancy at birth, total (years)
• NY.GDP.PCAP.KD: GDP per capita (constant 2015 US$)
• SP.POP.TOTL: Population, total

df_wdi <- WDI(
  country = "all", 
  indicator = c(lifeExp = "SP.DYN.LE00.IN", pop = "SP.POP.TOTL", gdpPercap = "NY.GDP.PCAP.KD")
)

---

df_wdi

---

df_wdi_extra <- WDI(
  country = "all", 
  indicator = c(lifeExp = "SP.DYN.LE00.IN", pop = "SP.POP.TOTL", gdpPercap = "NY.GDP.PCAP.KD"), 
  extra = TRUE
)

---

df_wdi_extra

---

1.1.2 Exploratory Data Analysis

1.1.2.1 What is EDA (Posit Primers: Visualise Data)

1. EDA is an iterative cycle that helps you understand what your data says. When you do EDA, you:

2. Generate questions about your data

3. Search for answers by visualising, transforming, and/or modeling your data

Use what you learn to refine your questions and/or generate new questions

EDA is an important part of any data analysis. You can use EDA to make discoveries about the world; or you can use EDA to ensure the quality of your data, asking questions about whether the data meets your standards or not.

---

1.1.3 Open and Public Data, World Bank

1.1.3.1 Open Government Data Toolkit: Open Data Defined

The term ``Open Data’’ has a very precise meaning. Data or content is open if anyone is free to use, re-use or redistribute it, subject at most to measures that preserve provenance and openness.

1. The data must be , which means they must be placed in the public domain or under liberal terms of use with minimal restrictions.
2. The data must be , which means they must be published in electronic formats that are machine readable and non-proprietary, so that anyone can access and use the data using common, freely available software tools. Data must also be publicly available and accessible on a public server, without password or firewall restrictions. To make Open Data easier to find, most organizations create and manage Open Data catalogs.

---

1.1.4 World Bank: WDI - World Development Indicaters

• World Bank: https://www.worldbank.org
• Who we are:
  • To end extreme poverty: By reducing the share of the global population that lives in extreme poverty to 3 percent by 2030.
  • To promote shared prosperity: By increasing the incomes of the poorest 40 percent of people in every country.
• World Bank Open Data: https://data.worldbank.org
  • Data Bank, World Development Indicators, etc.
• World Development Indicators (WDI) : the World Bank’s premier compilation of cross-country comparable data on development; 1400 time series indicators
  • Themes: Poverty and Inequality, People, Environment, Economy, States and Markets, Global Links
  • Open Data & DataBank: Explore data, Query database
  • Bulk Download: Excel, CSV
  • API Documentation

---

1.1.5 R Package WDI

• WDI: World Development Indicators and Other World Bank Data
• Search and download data from over 40 databases hosted by the World Bank, including the World Development Indicators (‘WDI’), International Debt Statistics, Doing Business, Human Capital Index, and Sub-national Poverty indicators.
• Version: 2.7.4
• Materials: README - usage
  • NEWS - version history
• Published: 2021-04-06
• README: https://cran.r-project.org/web/packages/WDI/readme/README.html
• Reference manual: WDI.pdf

---

1.1.6 Function WDI

• Usage

WDI(country = "all",
    indicator = "NY.GDP.PCAP.KD",
    start = 1960,
    end = 2020,
    extra = FALSE,
    cache = NULL)

• Arguments See Help!
  • country: Vector of countries (ISO-2 character codes, e.g. “BR”, “US”, “CA”, or “all”)
  • indicator: If you supply a named vector, the indicators will be automatically renamed: c('women_private_sector' = 'BI.PWK.PRVS.FE.ZS')

---

1.1.7 Function WDIsearch

library(WDI)

WDIsearch(string = "NY.GDP.PCAP.KD", 
          field = "indicator", cache = NULL)

---

WDIsearch(string = "population", 
          field = "name", short=FALSE, cache = wdi_cache)

---

WDIsearch(string = "NY.GDP.PCAP.KD", 
  field = "indicator", short = FALSE, cache = NULL)

WDIsearch(string = "gdp", 
  field = "name", short = TRUE, cache = NULL) 

---

1.1.8 Use cash

WDIbulk downloads the zip file of Bulk Downloads in WDI site , it is a list containing 6 data frames: Data, Country, Series, Country-Series, Series-Time, FootNote.

timeout: integer maximum number of seconds to wait for download

```r
wdi$FootNote 

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->

---

#### Bulk Downloads: Data


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxud2RpIDwtIFdESWJ1bGsodGltZW91dCA9IDYwMClcbmBgYCJ9 -->

```r
wdi <- WDIbulk(timeout = 600)

trying URL 'https://databank.worldbank.org/data/download/WDI_csv.zip'
Content type 'application/x-zip-compressed' length 70064539 bytes (66.8 MB)
==================================================
downloaded 66.8 MB

<!-- rnb-source-end -->

<!-- rnb-output-begin eyJkYXRhIjoiRXJyb3I6IGF0dGVtcHQgdG8gdXNlIHplcm8tbGVuZ3RoIHZhcmlhYmxlIG5hbWVcbiJ9 -->

Error: attempt to use zero-length variable name

<!-- rnb-output-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

#### Bulk Downloads: Country


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxud2RpX2NhY2hlXG5gYGBcbmBgYCJ9 -->

```r
```r
wdi_cache

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

#### Bulk Downloads: Series


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuZ2xpbXBzZShXRElfZGF0YSlcbmBgYFxuYGBgIn0= -->

```r
```r
glimpse(WDI_data)

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

#### Bulk Downloads: Country-Series


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuV0RJX2RhdGEkc2VyaWVzXG5gYGBcbmBgYCJ9 -->

```r
```r
WDI_data$series

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

#### Bulk Downloads: Series-Time


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuV0RJX2RhdGEkY291bnRyeVxuYGBgXG5gYGAifQ== -->

```r
```r
WDI_data$country

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

#### Bulk Downloads: Footnote


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuV0RJX2RhdGEkY291bnRyeSAgJT4lIGZpbHRlcihjb3VudHJ5ID09IFxcSmFwYW5cXClcbmBgYFxuYGBgIn0= -->

```r
```r
WDI_data$country  %>% filter(country == \Japan\)

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


---

### WDIcache

Download an updated list of available WDI indicators from the World Bank website. Returns a list for use in the WDIsearch function.


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuV0RJc2VhcmNoKHN0cmluZyA9IFxcZ2RwXFwsIFxuICBmaWVsZCA9IFxcbmFtZVxcLCBzaG9ydCA9IEZBTFNFLCBjYWNoZSA9IHdkaV9jYWNoZSkgXG5gYGBcbmBgYCJ9 -->

```r
```r
WDIsearch(string = \gdp\, 
  field = \name\, short = FALSE, cache = wdi_cache) 

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->


Downloading all series information from the World Bank website can take time. The WDI package ships with a local data object with information on all the series available on 2012-06-18. You can update this database by retrieving a new list using `WDIcache`, and then feeding the resulting object to `WDIsearch` via the cache argument.

---


<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuY28ycGNhcCA8LSBXREkoY291bnRyeSA9IFxcYWxsXFwsIGluZGljYXRvciA9IFxcRU4uQVRNLkNPMkUuUENcXCwgc3RhcnQgPSAxOTYwLCBlbmQgPSBOVUxMLCBleHRyYSA9IFRSVUUsIGNhY2hlID0gd2RpX2NhY2hlKVxuYGBgXG5gYGAifQ== -->

```r
```r
co2pcap <- WDI(country = \all\, indicator = \EN.ATM.CO2E.PC\, start = 1960, end = NULL, extra = TRUE, cache = wdi_cache)

<!-- rnb-source-end -->

<!-- rnb-chunk-end -->


<!-- rnb-text-begin -->



---

### WDI_data

List of 2 data frames

The first character matrix includes a full list of WDI series. This list is updated semi-regularly. Users can refresh the list manually using the 'WDIcache()' function and search in the updated list using the 'cache' argument.



<!-- rnb-text-end -->


<!-- rnb-chunk-begin -->


<!-- rnb-source-begin eyJkYXRhIjoiYGBgclxuYGBgclxuY28ycGNhcFxuYGBgXG5gYGAifQ== -->

```r
```r
co2pcap

```

---

---

---

---

1.1.9 World Development Indicators - Summary

Find indicators:

1. WDIsearch(string = "gdp", field = "name", short = FALSE, cache = NULL)
2. WDI: Data Themes
3. Browse by Indicators: https://data.worldbank.org/indicator
   • Featured Indicators or All Indicators
   • Obtain the indicator from the detail or the URL

---

Indicator: EN.ATM.CO2E.PC

---

---

---

1.1.10 readr, readxl

readr, ggplot2; Public Data, WDI, WIR, etc

1.2 Data Visualization and `ggplot2’

1.2.1 Learning Resouces

• Posit Primers:
  • Visualize Data: Learn how to use ggplot2 to make any type of plot with your data. Then learn the best ways to visualize patterns within values and relationships between variables.
• r4ds: Explore, II

1.2.2 Exploratory Data Analysis

1.2.2.1 What is EDA?

EDA is an iterative cycle that helps you understand what your data says. When you do EDA, you:

1. Generate questions about your data

2. Search for answers by visualising, transforming, and/or modeling your data

3. Use what you learn to refine your questions and/or generate new questions

EDA is an important part of any data analysis. You can use EDA to make discoveries about the world; or you can use EDA to ensure the quality of your data, asking questions about whether the data meets your standards or not.

1.2.2.2 Two useful questions

There is no rule about which questions you should ask to guide your research. However, two types of questions will always be useful for making discoveries within your data. You can loosely word these questions as:

1. What type of variation occurs within my variables?
2. What type of covariation occurs between my variables?

The rest of this tutorial will look at these two questions. To make the discussion easier, let’s define some terms…

1.2.3 Data Visualization

1.2.4 ggplot2 Basics

visualization

1.2.5 World Inequility Report

1.2.6 ggplot2 Extra